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REAL-TIME BOOKMARKING OF STREAMING MEDIA ASSETS 



FIELD OF INVENTION 

The invention is related to audio/video storage and multimedia 
5 presentation systems. 

BACKGROUND OF THE INVENTION 

A multimedia presentation system enables a viewer to select one or 
more segments to watch by displaying a series of teasers, or short clips, that 
10 describe the segments. 

In some systems, the teasers are presented first, followed by the full 
stories. The user can interact with the presentation engine to influence the 
presentation sequence by either jumping to a specific story during the 
presentation of the respective teaser or by skipping a story to continue with 
15 the next story, or another continuation point. 

The problem with this system is that this system only allows changing 
the "position-pointer" in an ongoing presentation. There is also no real indexing 
to the stories. The viewer is unable to setup a presentation sequence 
dynamically for passive viewing afterwards. 
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SUMMARY OF THE INVENTION 

A method for real-time bookmarking of streaming media assets is 
disclosed. In one embodiment, the method includes dynamically changing a 
presentation sequence of a plurality of video segments based on one or more 
bookmark signals from a viewer. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of example and not limitation 
in the figures of the accompanying drawings, in which like references indicate 
similar elements, and in which: 
5 Figure 1 shows an embodiment of a method for bookmarking. 

Figure 2 is a block diagram of an on-site media system having a 
dedicated service module. 

Figure 3A is a block diagram of data recorded on a dedicated service 
module. 

10 Figure 3B is a diagram of multiple designs of a dedicated service 

module. 

Figure 4 is a block diagram of another configuration of a dedicated 
service module. 

Figure 5 is a functional block diagram of an interactive media system 
15 including content provider and viewer systems with functions. 
Figure 6A is a diagram of a fine-grain media stream. 
Figure 6B is a television view generated using the interactive media 
system. 
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DETAILED DESCRIPTION 

A method for real-time bookmarking of streaming media assets is 
disclosed. In one embodiment, the method includes dynamically changing the 
presentation order of a plurality of video segments based on one or more 

5 bookmark signals from a viewer. 

An advantage of this method is that the viewer receives a full overview of 
the available segment material. It is not necessary for the viewer to revisit the 
teasers to access other segment content of interest. The viewer can easily and 
dynamically determine the presentation sequence for subsequent passive and 

10 customized viewing. 

An apparatus, such as an interactive service module, can present 
television segments to a viewer on demand. The interactive service module 
can perform a method for real-time bookmarking of streaming media assets. 
The interactive service module may include a tuner to receive data for 

15 television segments, and a computer readable memory to store the segment 
data. Teasers associated with each segment may also be received by the tuner 
and stored in memory. Metadata may be used to identify each segment and 
its corresponding teaser. The metadata may also be received by the tuner and 
stored in memory. The metadata may be used to enable the viewer to control 

20 the presentation order of several segments that are displayed to the viewer. A 
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presentation engine of the interactive service module may present the content 
based on viewer preferences. 

For example, digital Audio/Video (AV) content material, e.g. video 
clips representing a television news segment, may be available to the 

5 interactive service module from random access storage, either locally or 

through a network. For each story, represented by one or more video clips, an 
additional teaser video clip is available from storage. Alternatively, a table of 
contents (TOC) can be retrieved from storage. A teaser clip introduces a 
single story and gives an impression about the topic of the story. Descriptive 

10 metadata may be used by the interactive service module to identify separate 
stories in the video material and to identify their corresponding teasers. 

A dynamic navigation mechanism to perform real-time bookmarking may 
be executed by the interactive service module. The mechanism enables a 
viewer to send a signal to the presentation engine during the presentation of a 

15 teaser indicating that the corresponding story is of interest. The presentation 
of the teasers continues until all teasers have been presented, but the 
subsequent presentation structure of the corresponding stories is changed 
according to the viewer's bookmark signals. This results in a customized 
presentation of the bookmarked stories. 

20 A method for bookmarking is shown in Figure 1. For a plurality of 

segments, each segment is associated with a corresponding teaser, step 110. 
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Each teaser is displayed to the viewer in a sequential order, step 120. During 
the presentation of a given teaser, the viewer is enabled to send a bookmark 
signal indicating that the corresponding segment or story, is of interest, step 
130. If the viewer sends a bookmark signal, the corresponding segment is 

5 bookmarked as of interest to the viewer, step 140. The method determines 
whether all teasers have been presented to the viewer, step 150. If not, the next 
teaser in the sequential order is displayed and steps 120 through 150 are 
repeated. If all teasers have been presented, then the presentation order of the 
segments is dynamically changed based on the bookmark signals, step 160. For 

10 example, the programs that are bookmarked may be displayed before the 

programs that are not bookmarked. The segments are presented to the viewer 
in the dynamically changed presentation order, step 170. 

Alternatively, instead of sending a bookmark signal to indicate that the 
story is of interest, a viewer can send a signal to indicate that the story is not of 

15 interest. The "not of interest" signal can be used to place the corresponding 
story at a later position in the presentation sequence, or to remove the story 
entirely from the presentation sequence. A neutral signal may also be sent to 
indicate that the viewer is neither interested nor uninterested in the 
corresponding program. 

20 The method for bookmarking and dynamically changing of the 

presentation order is not limited to bookmarking during the teaser 
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presentation. In one embodiment, the method for bookmarking may also be 
used during a presentation of a story to indicate that the current story is of 
interest, but should be presented later or with reduced priority. Thus, this 
enables the viewer to postpone the presentation of the current story, and 
5 changes the presentation order dynamically. 

In one embodiment, a method to bookmark or postpone a story is not 
limited to a television news segment environment. The method can be applied 
to situations where a streaming media presentation order is dynamically 
changed based on viewer input, such as a table of contents of a video library, a 

10 music video, or an audio-only application, for example. 

Figures 2 through 5 show embodiments of an interactive service module 
for real-time bookmarking of streaming media assets. Referring now to Figure 
2, a block diagram of an on-site media system having a dedicated service 
module is shown, in accordance with one embodiment of the present 

15 invention. To provide a context for the dedicated service module, on-site 
media system 200 shows one embodiment of a larger system in which the 
dedicated service module may be implemented to provide a dedicated on-site 
media service. On-site media system 200 includes a control/data bus 202 for 
communicating information, a central processor unit 204 for processing 

20 information and instructions, coupled to bus 202, and a memory unit 206 for 
storing information and instructions, coupled to bus 202. Memory unit 206 can 
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include random access memory (RAM) 206a, for storing temporal information 
and instructions for central processor unit 204, and read only memory (ROM) 
206b, for storing static information and instructions for central processor unit 
204. System 200 also includes a display device 218 coupled to bus 202, for 
5 viewing data, and a signal source 212, coupled to dedicated service module 
210 via line 213a for providing a signal. 

On-site media system 200 also includes a dedicated service module 210, 
coupled to bus 202, to provide a media signal. Dedicated service module 210 
can also be referred to as a dedicated media device or a dedicated service 

10 cartridge, depending on its specific configuration. Dedicated service module 
210, enables the on-site media service to be implemented by providing 
dedicated tuning and guaranteed storage for a broadcast signal. The dedicated 
tuning provides a dedicated path from the broadcast stream into the 
guaranteed storage device. More specifically, dedicated service module 210 

15 includes one or more dedicated tuners and one or more dedicated media 
storage devices, coupled to each other. More details of dedicated service 
module 210 are provided in subsequent figures. Dedicated service module 210 
can allow for proprietary encoding of service information in datacast 
associated with broadcast streams with built-in support in the dedicated 

20 service module for processing the service information. The dedicated service 
module can also support software reconfiguration via broadcast at several 
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different levels (e.g., device upgrade, software platform upgrade, and content 
upgrade). 

Signal source 211 can be any device, such as an antennae for receiving a 
broadcast, a cable interface for line transmission, or a dish for receiving 
5 satellite broadcast. Display device 218 of Figure 2 can be any type of display, 
including an analog or a digital television, or a personal computer (PC) 
display. While processor 204 and memory 206 are shown as individual 
entities, they may be incorporated into another component. For example, 
processor 204 and memory 206 may be new components or may be existing 

10 components in display device 218, e.g. a digital television (DTV), dedicated 
service module 210, or in a set-top box (not shown). Additionally, while 
dedicated service module 210 is shown individually, it may be integrated into 
other components, such as display device 218, as shown in configuration B of 
subsequent Figure 3B. 

15 System 200 also includes an optional Internet connection 216 coupled to 

bus 202 for transmitting information to, and receiving information from, the 
Internet. The information may be a video segment, such as an A/V clip for 
example. An optional user input device 212, e.g. a keypad, remote control, etc., 
coupled to bus 202 is also included in system 200 of Figure 2, to provide 

20 communication between system 200 and a user. Optional local 

receiver /source 208, which can be a set top box in one embodiment, is coupled 
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to bus 202 to provide a media signal. Optional local receiver /source 208 can 
alternatively be located inside display device 218. Optional local /receiver 
source 208 can allow viewer options such as simultaneous viewing of a 
segment through a tuner or source that is independent of the dedicated tuners 
5 of dedicated service module 210. Thus, the dedicated tuner, e.g. 201, in 
dedicated service module 210, always provides a dedicated path for a given 
medial signal. 

Bus 202 provides an exemplary coupling configuration of devices in on- 
site media system 200. Bus 202 is shown as a single bus line for clarity. It is 

10 appreciated by those skilled in the art that bus 202 can include subcomponents 
of specific data lines and /or control lines for the communication of commands 
and data between appropriate devices. It is further appreciated by those 
skilled in the art that bus 202 can be a parallel configuration, or a IEEE 1394 
configuration, that bus 202 can include numerous gateways, interconnect, and 

15 translators, as appropriate for a given application. 

It is also appreciated that on-site media system 200 is exemplary only 
and that the present invention can operate within a number of different media 
systems including a commercial media system, a general purpose computer 
system, etc. Furthermore, the present invention is well-suited to using a host 

20 of intelligent devices that have similar components as exemplary on-site media 
system 200. 
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Referring now to Figure 3 A, a block diagram of a dedicated service 
module is shown, in accordance with on embodiment of the present invention. 
Dedicated service module 210, also referred to as a dedicated media device, or 
a dedicated service cartridge depending upon the configuration, includes a 
5 media storage adapter 306, a tuner adapter 308, and interfaces 304a and 304b 
for tuner adapter 308 and for media storage adapter 306, respectively. Media 
storage adapter 306 includes appropriate mechanical and electrical 
components to accommodate a dedicated media storage device. Similarly, 
tuner adapter 308 includes appropriate mechanical and electrical components 

10 to accommodate a dedicated tuner. Media storage adapter 306 is coupled to 
tuner adapter 308 via one or more dedicated tuners, e.g. tuner 210a, and one or 
more dedicated disks, e.g. 203a, respectively coupled together in exclusive 
pairs, in the present embodiment. 

Interface 304a, in turn includes a multiplexed broadcast stream 213a 

15 coupled to tuner adapter 308. Interface 304b includes a two-way display 

device control line 316, which can be coupled to media storage adapter 306 via 
bus 315. In one embodiment, bus 315 can be coupled to bus 202 of Figure 2. 
Interface 304b also includes an optional Internet 304b also includes an optional 
Internet connection 213b that may be directly coupled to one or more 

20 dedicated cartridges, e.g. open slot 313, in one embodiment. In another 

embodiment, only a dedicated storage device is coupled to optional Internet 



80398.P334 



12 



connection 213b because the Internet connection bypasses the need for a 
dedicated tuner. 

The present embodiment of dedicated service module 210 includes 
multiple tuners and disks, exclusively coupled to each other as shown. 

5 However, the present invention is well-suited to many different 

configurations. For example, one or more allocated partitions, or portions, of a 
single disk can be utilized in lieu of separate storage devices, e.g. one hard 
drive with five partitions replaces five separate hard drives. In yet another 
embodiment, a "gang" of multiple tuners could be cooperatively shared across 

10 a current active receiver, under the assumption that not all of the multiple 
broadcast signals would want to be tuned and recorded at all times. In this 
latter embodiment, each broadcast signal can still have a guaranteed capacity 
of disk storage. This latter embodiment would trade off the cost of a service 
module with the level of dedicated service desired. 

15 While the present embodiment arranges multiple tuner-storage pairs, 

e.g. 203a and 201a pair and 203b and 201b pair, in a parallel manner, the 
present invention is well-suited to alternative coupling arrangements. For 
example, in one embodiment, tuner-storage pairs may be daisy-chained to 
deliver the multiplex broadcast signal to each dedicated tune. 

20 Bus 315, for providing multiplexed broadcast stream, is conformal to the 

Institute of Electrical and Electronic Engineers (IEEE) 1394 standard in one 
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embodiment. Furthermore, two-way media/ data line 316 is also compatible 
with the IEEE 1394 standard, in one embodiment. 

The connection to the optional local receiver, e.g. optional local 
receiver/ source 208 of Figure 2 (viz., a tuner in a television or Set Top Box 
5 (STB)), enables a viewer to access segmenting from dedicated service module 
210 as a set of streams to complement a conventional broadcast from optional 
local receiver. Furthermore, the present invention is well-suited to using many 
different configurations of dedicated tuner-storage devices. For example, one 
or more dedicated media storage devices may be committed to a single 

10 dedicated tuner, thus allowing concurrent recording and viewing. Alternative 
embodiments are provided in subsequent figures. 

The present invention also shows one open slot 312 for an additional 
dedicated tuner-storage pair. However, the present invention is well-suited to 
providing interactive media device 210 with any number of open slots and any 

15 number of installed dedicated timer-storage pairs. 

Additionally, dedicated storage device 210 has a modular interface to 
media storage adapter 306 and tuner adapter 308 in the present embodiment. 
That is, the present embodiment of Figure 3A is a form-factor media tower into 
which a consumer can plug or unplug dedicated service cartridges, having the 

20 dedicated tuners and media storage devices, units. 



80398.P334 



14 



Referring now to Figure 3B, multiple designs of a dedicated service 
module are shown, in accordance with one embodiment of the present 
invention. Configurations A-C show alternative configurations for a modular 
embodiment of the dedicated service module, e.g. where the dedicated tuner- 
5 disk, pairs are removable cartridges. Configuration A shows a traditional 
stand alone dedicated service module device. Configurations B shows an 
integrated dedicated service module that is built-in to a display device. Lastly, 
configuration C shows a stacked stand alone dedicated service module device. 
The dedicated tuner-storage pairs can be plugged into a back-plane of any 

10 device appropriate for consumer use. The present invention is well-suited to 
using any other stacking and coupling configuration for a modular dedicated 
service module. It is appreciated that the integrated service module devices 
shown in Figure 3B are exemplary. The present invention is well-suited to a 
wide range of designs and configurations for the dedicated service module and 

15 the cartridge embodiment of the dedicated tuner-disk pair. 

Referring now to Figure 4, a block diagram of another configuration of a 
dedicated service module is shown, in accordance with one embodiment of the 
present invention. Dedicated service module 310a, also referred to as a 
dedicated service cartridge, includes a media storage device 402, and a tune 

20 404. In the present embodiment, both the media storage device 402 and the 
tuner 404 to which it is coupled, are dedicated to a specific content provider. 
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For example, tuner 404 may be preset to receive a broadcast frequency 
corresponding to a national news broadcaster. In another embodiment, 
dedicated service module 310a can be generic cartridge that is segmented with 
tuning instructions suitable to tune in the appropriate broadcast signal, in 

5 response to a subscription, or to some other business module. 

Tuner 404 of Figure 4 is coupled to adapter 406 via data line 408 to 
receive source signal, e.g. a broadcast spectrum. Media storage device 402 and 
tuner 404 are coupled via control line 410 to adapter 406 to receive instructions 
to tuner and/or media storage device in accordance with on-site media service 

10 software and commands, e.g. via processor 204 and memory 206 of Figure 2. 
Media storage device 402 is also coupled to adapter 406 via line 416 to provide 
media data from media storage device to a media system, such as that shown 
in Figure 2. Line 414 provides the dedicated media signal, tuner by tuner 404, 
to dedicated media storage 402. In another embodiment, data and control can 

15 be multiplexed on a single line. Adapter 406 allows dedicated service module 
310a to interface with an interactive media system, such as the embodiment 
shown in Figure 3A. As mentioned in Figure 3A, another embodiment of a 
dedicated service module allows for dedicated Internet access, and thus 
eliminates the dedicated tuner but retains the dedicated media storage device. 

20 In one embodiment, dedicated service module 310a of Figure 4 is a 

modular unit that a consumer can purchase and simply insert to an interactive 
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media system. Media storage device 402 is shown as a single device in Figure 
4. However, the present invention is well-suited to using many different 
configurations and embodiment. In another embodiment, multiple 
independent read/ write access mechanisms can be adapted to a single 

5 recording disk for simultaneous read/write aspects. In the present 

embodiment, media storage device 402 is a hard drive unit, similar to those 
used in PCs. However, the present invention is well-suited to using any media 
recording device, as is appropriate for a given application. Additionally, the 
tuners and disks of the dedicated service module are capable of recording and 

10 delivering a fixed number of streams, e.g. for input and output, as appropriate 
for the service. 

While Figure 4 provides dedicated tuner-storage device 310a as a 
removable modular embodiment, it can also be configured as a fixed internal 
device for incorporation into a display device, such as digital television. 

15 Additionally, tuner 404 can be implemented as a digital or an analog device. 
While Figure 4 shows a single media storage device allocated to a single 
dedicated tuner, the present invention is well-suited to different 
configurations. For example, in lieu of dedicated an entire media storage 
device to a single dedicated tuner, one embodiment of the present invention 

20 dedicates one or more partitions of a common media storage device to a single 
dedicated tuner. In this manner, the single common storage device can be 
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shared among multiple timers while still satiating the goal of guaranteed 
storage capacity for a broadcast signal. 

Referring now to Figure 5, a functional block diagram of an interactive 
media system including content provider media system and on-site media 

5 system is shown, in accordance with one embodiment of the present invention. 
Interactive media system 500 includes a content provider media system 520, 
also referred to as content provider, and includes an on-site media system 530. 

Content provider media system 520 includes a media content database 
504 that provides media content data, as indicated by the arrows, to an editing 

10 block 506 and to an encoder engine block 512. Any format of data can be 
stored in the media content database 504. For example, in one embodiment, 
the media content data stored in media content database 504 is compliant with 
the Moving Picture Experts Group-2 (MPEG-2) standard. Media content 
database 504 also communicates, as shown by arrow, with on-site media 

15 service database 502, which in turn provides data to editing block 506. On-site 
media service database 502 includes metadata, content options, service data 
and service options, function data and functional options, and interactive data 
and interactive options, in one embodiment. However, the present invention 
is well-suited to storing any other type of data that would enhance the on-site 

20 media service. These data may be commands, software code, descriptive 
structures, or other information useful to an on-site media system. 
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Additionally, the granularity of the on-site media service data can range from 
segment-based to clip based, or shorter time-segments. Besides the data 
described, the present invention is well-suited to tying any other on-site media 
service data to the content data in order to provide an on-site media service 

5 that provides value to both content provider and viewer. 

Editing block 506 can be thought of as the segment director's editing 
service which takes the raw production data and formats it into a television 
segment. The communication link between on-site media service database 502 
and media content database 504 ties the on-site media service information to 

10 the core broadcast segment content, e.g. a core audiovisual news segment. 
Editing block 506 passes reference information, relating to the media content 
desired to be transmitted, to cutlist block 510. The service information 
corresponding to the desired segment content to be transmitted is sent in 
parallel from editing block 506 to the on-site media service data block 508. The 

15 output of blocks 508 and 510 is provided in parallel with the actual content 
data, referenced in cutlist block 510, from media content database 504, to an 
encoder block 512 which subsequently provides a media signal to a user, e.g. 
on-site media system 530. While the present embodiment performs some 
editing of raw production media data, it still provides a sufficient amount of 

20 content data to a local media system to allow the viewer some options, if 
desired, in the selection of the content. 
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In one embodiment, encoder block 512 is a transmitter that provides a 
terrestrial broadcast of media signal 522. However, the present invention is 
well-suited to any means of transmitting the media signal, such as cable or 
satellite. The present invention is also well-suited to a wide variety of methods 

5 for encoding data for transmission to an on-site media system. 

The present embodiment of content provider interactive media system 
shown in Figure 5 can be implemented with hardware that includes a 
processor coupled to a memory for storing instructions and commands and 
method steps. The hardware implementation would also include a media 

10 storage device such as one or more hard drives coupled to the processor, a user 
input device and a transmitter, all coupled to the processor. 

The other component of interactive media system 500 is on-site media 
systems 530, which can be grouped in different sections for clarity. A first 
functional section 552 performs data reception in on-site media system 530. A 

15 second functional section 554 performs data recording, while a third functional 
section 556 performs data presentation. In data reception section 552, 
broadcast signal 522 is first received at a decoder functional block 532 which 
transmits, as shown by arrows, the decoded signal to content manager block 
536. An optional information source, such as Internet data block 534, can 

20 provide additional data that can be integrated in the functional stages of on- 
site media system 530. Thus, for example, Internet data block 534 can 
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automatically cache a specific Web content prior to viewer presentation in 
order to give the viewer a sense of instant access during the presentation. 
Additionally, a back channel can be enabled either via this Internet block or 
through other mechanisms, such as a cable modem for cable-based broadcast. 

5 Decoder 532 can be a dedicated tuner, such as the dedicated tuner 404 

shown in Figure 4, or the dedicated timer portion, e.g. timer 201a of Figure 3A. 
Content manager block 536 provides a filtering function on the decoded media 
signal. That is, content manager block 536 segregates content from on-site 
media service data and sends them to respective storage devices, e.g. media 

10 content hard drive 538 for content data, and on-site media service drive 540. 
These separate drives are figurative in one embodiment as both signals can be 
tied together by writing them to a single disk. Content manager block 530 can 
also implement a first-level content filter that, according to subscription 
software, user profile, or viewer-selected options, decides whether to record 

15 the media signal, e.g. to media content hard drive 538, or to ignore the signal 
and not record it. Content manager can be implemented using instructions 
stored on memory 206 and implemented on processor 204 of on-site media 
hardware system 200, as shown in Figure 2, in one embodiment. 

The next stage of on-site media system 530 is the data presentation 

20 formatting stage 556. In this stage, on-site media service information is 

received from on-site media service drive 540 at showflow engine block 544. 
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Showflow engine block 544 formats and implements on-site media service data 
for subsequent integration with content data. Then showflow engine block 544 
provides the processed data to rendering engine 542. Similarly, content data is 
received from dedicated media content hard drive 538 at rendering engine 542. 
Rendering engine 542 performs the formatting and integration of the desired 
images to be viewed on display device, in one embodiment. A wide variety of 
media elements, e.g. video, audio, text, etc., may be combined in many 
different formats to provide a desired composite presentation for viewing on 
display device 546. For example, electronic segmenting guide (EPG) 
information may be more dynamically formatted, including clips from the 
actual segment. That is, the EPG can be enabled via the present invention to 
allow users to view previews of any segment for which a commercial has been 
broadcast instead of the typical text tile of a segment in a two-dimensional 
grid. In another embodiment, a user segment interface that presents menus, 
media clips, or other data, may be overlaid onto content images for display 
device 546. 

Rendering engine 542 transfers presentation data to display device 546 
for the final stage of presenting display 558. User input is communicated back 
to rendering engine 542 via line 548. User input can be received via push- 
button selection on set-top box or a television unit, or from an other source, 
such as a remote control input. 
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While the present embodiment only shows a single decoder 532 and a 
single dedicated hard drive, e.g. disk set 538 and 540, dedicated for a single 
media signal, e.g. signal 522, the present invention is capable of functional 
blocks for multiple units in parallel, in one embodiment. In another 
5 embodiment, memory and processor resources (e.g. memory 206 and 

processor 204 of Figure 2) are utilized to accomplish engine functions (e.g. 
rendering engine 542, content manager function 536, and showflow engine 544, 
as well as other engines not shown). It is appreciated that the engine functions 
performed on memory and processor are accomplished in a serial manner if 

10 only a single processor is implemented. In another embodiment, multiple 
processors can be utilized to accomplish dedicated functions in on-site media 
system 530, in a parallel or serial fashion. 

Referring now to Figure 6 A, a diagram of a fine-grain media stream 600 
is shown, in accordance with one embodiment of the present invention. Figure 

15 6A illustrates segment data and duration as a physical block 601. Segment 
block 601 has a time span 606 over which content is presented. The present 
invention provides a very fine grain metadata tagging for segment content. 
For example, Figure 6A shows metadata labeling at a clip level, e.g. metadata 
tag 603a for clip content 602a having a time span of 604. This is repeated for 

20 any quantity of clips within the segment. The present invention is well-suited 
to using any scale of metadata labeling, as appropriate for an application. For 
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example, tagging clips with metadata would be appropriate for some news 
segments having many short clips in the segment. By using the fine-grain 
metadata tagging, the present invention provides the necessary data and 
infrastructure for an on-site media service to provide enhanced services and 
5 functions to a viewer. One such feature would be fine-grain navigation and 
compilation of media content related to a specific viewer interest or inquiry. 

Referring to now to Figure 6B, a television view generated using the 
interactive media system is shown, in accordance with one embodiment of the 
present invention. Television view 650 is shown on a conventional television 

10 658. Segment user interface 654 is provided along with a presenter 656 image, 
both of which are overlaid onto a core media content 652, e.g., an airplane 
story clip. The present invention provides the appropriate audio and 
associated data corresponding to the video data. Notably, the content- 
provider can exercise editorial content over when and what service, function, 

15 and content options are available to the viewer, e.g. through the segment user 
interface. This allows greater choice to a viewer while still satisfying a 
business model for the content provider. 

Television view 650 illustrates how the content provider, e.g. 
broadcaster, can control some of the recording, management formatting, and 

20 presentation of media to a user. Similarly, television view 650 illustrates how 
the viewer can interact with predetermined menu options to accomplish 
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desired services and features, e.g. viewing segment user interface for 
alternative clips, selecting a function from a menu in segment user interface 
654, or adjusting the presenter format 656. The present invention is well-suited 
to using any combination of these, and other, presentation formats and 

5 contents to present an on-site media service to the viewer, and or user. 
Furthermore, each of the several on-site media services described can be 
implemented independent of each other, or in any combination. The same 
independence exists for the interactive feature of the on-site media service. 
The method can be implemented in an environment with software 

10 controlled access to streamed media, where descriptive Metadata is used to 
relate teaser AV material to full length versions of the corresponding content. 

These and other embodiments of the present invention may be realized 
in accordance with these teachings and it should be evident that various 
modifications and changes may be made in these teachings without departing 

15 from the broader spirit and scope of the invention. The specification and 
drawings are, accordingly, to be regarded in an illustrative rather than 
restrictive sense and the invention measured only in terms of the claims. 
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CLAIMS 



What is claimed is: 
11. A method comprising: 

2 dynamically changing a presentation order of a plurality of segments 

3 based on one or more bookmark signals from a viewer. 

1 2. The method of claim 1, further comprising, for each segment, associating 

2 each segment with a corresponding teaser. 

1 3. The method of claim 2, further comprising sequentially presenting each 

2 of the teasers to the viewer. 

1 4. The method of claim 3, further comprising 

2 during the presentation of a given teaser, enabling the viewer to send a 

3 bookmark signal indicating that the corresponding segment is of interest. 

1 5. The method of claim 4, further comprising bookmarking the 

2 corresponding segment as of interest to the viewer if the viewer sends a 

3 bookmark signal. 
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1 6. The method of claim 1, further comprising presenting the segments to 

2 the viewer in the dynamically changed presentation order. 

1 7. The method of claim 6, wherein the presentation order is dynamically 

2 changed so that the bookmarked segments are displayed before the segments 

3 that are not bookmarked. 

1 8. The method of claim 7 further comprising during the presentation a 

2 given teaser, enabling the viewer to send a signal from the group comprising: 

3 a negative signal to indicate that the viewer is not interested in the 

4 segment, and a neutral signal to indicate that the viewer is neutral about the 

5 segment. 

1 9. The method of claim 1 further comprising 

2 displaying a table of contents having a plurality of entries to the viewer, 

3 wherein each entry in the table of contents corresponds to one of the video 

4 segments; 

5 enabling the viewer to modify the order of the entries of the table of 

6 contents; and 

7 displaying the video segments in the modified order of the 

8 corresponding entries in the table of contents. 
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1 10. A computer readable medium having instructions which, when executed 

2 by a processing system, cause the system to: 

3 dynamically change a presentation order of a plurality of segments 

4 based on one or more bookmark signals from a viewer. 

1 11. The medium of claim 10, wherein the executed instructions further cause 

2 the system to, for each segment, associate each segment with a corresponding 

3 teaser. 

1 12. The medium of claim 11, wherein the executed instructions further cause 

2 the system to sequentially present each of the teasers to the viewer. 

1 13. The medium of claim 12, wherein the executed instructions further cause 

2 the system to enable the viewer, during the presentation of a given teaser, to 

3 send a bookmark signal indicating that the corresponding segment is of 

4 interest. 

1 14. The medium of claim 13, wherein the executed instructions further cause 

2 the system to bookmark the corresponding segment as of interest to the viewer 

3 if the viewer sends a bookmark signal. 
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1 15. The medium of claim 10, wherein the executed instructions further cause 

2 the system to present the segments to the viewer in the dynamically changed 

3 presentation order. 

1 16. The medium of claim 15, wherein the presentation order is dynamically 

2 changed so that the bookmarked segments are displayed before the segments 

3 that are not bookmarked. 

1 17. The medium of claim 16 further comprising during the presentation a 

2 given teaser, wherein the executed instructions further cause the system to 

3 enable the viewer to send a signal from the group comprising: 

4 a negative signal to indicate that the viewer is not interested in the 

5 segment, and a neutral signal to indicate that the viewer is neutral about the 

6 segment. 

1 18. The medium of claim 10 wherein the executed instructions further cause 

2 the system to 

3 display a table of contents having a plurality of entries to the viewer, 

4 wherein each entry in the table of contents corresponds to one of the video 

5 segments; 
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6 enable the viewer to modify the order of entries of the table of contents; 

7 and 

8 display the video segments in the modified order of the corresponding 

9 entries in the table of contents. 

1 19. An apparatus comprising: 

2 means for dynamically changing a presentation order of a plurality of 

3 segments based on one or more bookmark signals from a viewer; and 

4 means for associating each segment with a corresponding teaser. 

1 20. The apparatus of claim 19, further comprising means for sequentially 

2 presenting each of the teasers to the viewer. 

1 21. The apparatus of claim 20, further comprising 

2 means for enabling the viewer, during the presentation of a given teaser, 

3 to send a bookmark signal indicating that the corresponding segment is of 

4 interest. 

1 22. The apparatus of claim 21, further comprising means for bookmarking 

2 the corresponding segment as of interest to the viewer if the viewer sends a 

3 bookmark signal. 
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1 23. The apparatus of claim 20, further comprising means for presenting the 

2 segments to the viewer in the dynamically changed presentation order. 

1 24. The apparatus of claim 23, wherein the presentation order is means for 

2 dynamically changed so that the bookmarked segments are displayed before 

3 the segments that are not bookmarked. 

1 25. The apparatus of claim 24 further comprising during the presentation a 

2 given teaser, means for enabling the viewer to send a signal from the group 

3 comprising: 

4 a negative signal to indicate that the viewer is not interested in the 

5 segment, and a neutral signal to indicate that the viewer is neutral about the 

6 segment. 

1 26. The apparatus of claim 19 further comprising 

2 means for displaying a table of contents having a plurality oft entries to 

3 the viewer, wherein each entry in the table of contents corresponds to one of the 

4 video segments; 

5 means for enabling the viewer to modify the order of entries of the table 

6 of contents; and 
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7 means for displaying the video segments in the modified order of the 

8 corresponding entries in the table of contents. 
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ABSTRACT 

A method for real-time bookmarking of streaming media assets is 
disclosed. In one embodiment, the method includes dynamically changing a 
presentation segment of a plurality of segments based one or more bookmark 
signals from a viewer. 
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FOR A PLURALITY OF SEGMENTS, ASSOCIATE 
EACH SEGMENT WITH A CORRESPONDING 
TEASER 



PRESENT TEASER TO A VIEWER 



DURING THE PRESENTATION OF A GIVEN 
TEASER, ENABLE THE VIEWER TO SEND A 
BOOKMARK SIGNAL INDICATING THAT THE 
CORRESPONDING PROGRAM IS OF INTEREST 



IF THE VIEWER SENDS A BOOKMARK SIGNAL, 

BOOKMARK THE CORRESPONDING 
PROGRAM AS OF INTEREST TO THE VIEWER 




ON THE DYNAMICALLY CHANGED 
PRESENTATION ORDER 
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Title 37, Code of Federal Regulations, Section 1.56 
Duty to Disclose Information Material to Patentability 

(a) A patent by its very nature is affected with a public interest. The public interest is best served, 
and the most effective patent examination occurs when, at the time an application is being examined, the 
Office is aware of and evaluates the teachings of all information material to patentability. Each individual 
associated with the filing and prosecution of a patent application has a duty of candor and good faith in 
dealing with the Office, which includes a duty to disclose to the Office all information known to that individual 
to be material to patentability as defined in this section. The duty to disclosure information exists with respect 
to each pending claim until the claim is cancelled or withdrawn from consideration, or the application becomes 
abandoned. Information material to the patentability of a claim that is cancelled or withdrawn from 
consideration need not be submitted if the information is not material to the patentability of any claim 
remaining under consideration in the application. There is no duty to submit information which is not material 
to the patentability of any existing claim. The duty to disclosure all information known to be material to 
patentability is deemed to be satisfied if all information known to be material to patentability of any claim 
issued in a patent was cited by the Office or submitted to the Office in the manner prescribed by §§1 .97(b)-(d) 
and 1 .98. However, no patent will be granted on an application in connection with which fraud on the Office 
was practiced or attempted or the duty of disclosure was violated through bad faith or intentional misconduct. 
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(1 ) Prior art cited in search reports of a foreign patent office in a counterpart application, and 

(2) The closest information over which individuals associated with the filing or prosecution of a 
patent application believe any pending claim patentably defines, to make sure that any material information 
contained therein is disclosed to the Office. 

(b) Under this section, information is material to patentability when it is not cumulative to 
information already of record or being made or record in the application, and 

(1 ) It establishes, by itself or in combination with other information, a prima facie case of 
unpatentability of a claim; or 

(2) It refutes, or is inconsistent with, a position the applicant takes in: 

(i) Opposing an argument of unpatentability relied on by the Office, or 

(ii) Asserting an argument of patentability. 

A prima facie case of unpatentability is established when the information compels a conclusion that a claim is 
unpatentable under the preponderance of evidence, burden-of-proof standard, giving each term in the claim 
its broadest reasonable construction consistent with the specification, and before any consideration is given to 
evidence which may be submitted in an attempt to establish a contrary conclusion of patentability. 
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(1) Each inventor named in the application; 

(2) Each attorney or agent who prepares or prosecutes the application; and 

(3) Every other person who is substantively involved in the preparation or prosecution of the 
application and who is associated with the inventor, with the assignee or with anyone to whom there is an 
obligation to assign the application. 

(d) Individuals other than the attorney, agent or inventor may comply with this section by 
disclosing information to the attorney, agent, or inventor. 
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